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Optimizing Experimental Designs Relative to Costs and Effect Sizes 

A general model is derived for the purpose of efficiently allocating integral numbers of 
units in multi-level designs given prespecified power levels. The derivation of the model 
is based on a constrained optimization problem that maximizes a general form of a ratio 
of expected mean squares subject to a budget constraint. This model provides more 
general closed form solutions than other available formulae. As such, the proposed 
methodology allows for the determination of the optimal numbers of units for studies that 
involve more complex designs. Further, the proposed model makes use of effect sizes and 
the estimates of variance components to optimize multi-level designs during the budget 
formulating stages. Thus, researchers are able to estimate the amount of currency needed 
to adjust power to a targeted level while precluding them to request too much or too little 
money in the budget planning phase of the study design. A procedure is also described 
for optimizing designs when estimates of variance components are unavailable. Case 
studies are also provided to demonstrate and examine the methodology. 

Keywords: Budget constraint; Effect size; Lagrange multiplier; Level of randomization; 
Multi-level design; Optimization; Power; Variance components 
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Optimizing Experimental Designs Relative to Costs and Effect Sizes 
1. INTRODUCTION 

The concern for the efficient allocation of economic resources in experimental 
designs has long been a topic of discussion (e.g., see Brooks, 1955; Cochran, 1977; 
Deming, 1953; Donner, Brown, & Brasher, 1990; Headrick & Zumbo, 2001; Hsieh, 

1988; Marcoulides, 1993; Moerbeek, van Breukelen, & Berger, 2000, 2001; Muller, 
LaVange, Ramey, & Ramey, 1992; Overall & Dalai, 1965; Raudenbush, 1997; Snijders 
& Bosker, 1993). For example. Brooks (1955) derived a procedure for determining the 
optimal subsampling number subject to a budget constraint for a design that involved 
two-stage sampling. The constraint consisted of nonzero finite fixed prices for each input 
of the design (Brooks, 1955, Equation 2). This constraint was extended to three-stage 
sampling (Cochran, 1977, Equation 10.43) and also used to determine optimal sampling 
numbers for some multi-level experimental designs (e.g., Headrick & Zumbo, 2001, 
Equation 3; Moerbeek et al., 2000, Equation 6). 

With this idea of an efficient allocation of resources in mind, let us first consider a 
(multi) r level design where c, represents the nonzero fixed price for each of the n, units 



used at the i-th level of the design (where i = 1 ,..., r ). For any particular r level design, a 
number of different null hypotheses, can be formulated and tested. However, in the test of 
any particular hypothesis, the form of the ratio of expected mean squares takes on a 
general form that can be expressed as follows: 






(la) 



where d> denotes the parametric form of the F ratio. The term al is the total component 



of variance present in both numerator and denominator. The term cr^ is the variance 
component associated with some treatment effect. The term m in the numerator is a 
general coefficient that denotes the total magnitude of all other coefficients associated 
with <7^ . The noncentrality parameter ( <5' ) associated with (la) can be expressed as: 



d = 



km<TZ 



(2a) 



where k is the number of means (from k populations) in the null hypothesis. 

Consider, for example, a r = 2 level design with three factors: factor A consisting 
of k populations each with second level units; factor B, crossed with factor A, and 
consisting of first level units; and factor C nested under factor B consisting of two 
types of observations for each of the units. Assuming factors B and C fixed and factor 
A random, the ratio of the expected mean squares in (la) and the noncentrality parameter 
in (2a) for the omnibus test for a difference across the k populations can be expressed as: 



o = 



al + 2n, a} + 2n,n.a^ 

— 7 —* ‘ , and 

(7, +2ni(Ji 



„ kln.n.al 
0 = ‘ V , where 

(7l+2n,a^ 



(lb) 



(2b) 



m = 2 ni« 2 . and (7^ = cr^ + 2n^cr^ in equations (la) and (2a) above. 

Because economic resources are scarce, a question to consider is what would be 
the optimal numbers of and «2 to use in the two level design described above? More 
generally, this question can be formulated in terms of r level designs and with respect to 
the additional concern for power as: Given a finite budget, what are the optimal integral 
units of to use in a r level design such that the selected units of n, yield a 
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targeted level power at minimum cost? 

Overall and Dalai (1965) proposed a procedure for obtaining the optimal numbers 
of units (n, ) for some multi-level designs based on (la) such that power could be 

maximized for a fixed budget. However, the problems with the Overall and Dalai (1965) 
procedure are its lack of generality and laborious nature. Specifically, the procedure 



suggested by Overall and Dalai (1965) requires the cumbersome task ot wnting out all 



T! i'll 



possible experimental situations given fixed prices and a total budget. For each of the 
experimental possibilities, the subsequent tasks are (a) refer to previous research to 
estimate the variance components, (b) determine the noncentrality parameter, and (c) 
refer to power tables to determine the optimal scenario that maximizes power subject to 
the total budget. Further, Overall and Dalai (1965) made no attempt to target a particular 
level of power. As a result, the optimal solutions may yield an unacceptable level power 
because of an inadequate initial budget (e.g., the maximum power for a given initial 
budget could be .40). 

The methodology of Brooks (1955), Cochran (1977), and Moerbeek et al. (2000) 
is based on minimizing error variance i.e., some specific forms of the denominator in (la) 
to obtain the optimal sampling units of . The problem with this method is that effect 

sizes, degrees of freedom, and power are not generally considered. Specifically, while 
these models do indeed minimize error variance, but similar to the procedure suggested 
by Overall and Dalai (1965), they may in general yield solutions with an unacceptable 
low level of power due to an insufficient budget. It should be noted that the procedure 
suggested by Moerbeek et al. (2000, p. 281) does allow for an effect size to be used to 
determine the minimum amount of dollars needed to achieve a certain level of power. 
However, their procedure is limited to two groups. 
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Moerbeek et al. (2000, Table 2) do offer convenient closed form solutions to 
obtain the optimal numbers of units in the context of two and three level designs. 
However, these equations are only applicable for some designs. For example, the 
equation for the solution to n, given in Moerbeek et al. (2000, Table 2, for two levels. 



and randomization at the class level) is not general enough to provide an optimum for 



/ 1 V>\ 
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Because of the work of such researchers as Cohen (1988), Glass (1976), and 
Hedges (1981), some methodologists (e.g., Kirk, 1996; Rosenthal, Rosnow, & Rubin, 
2000) are more concerned with the study and reporting of effect sizes - such as those 
related to < 7 ^^ in (la). Further, effect sizes are available (or can be estimated) to the 
investigator who is in the beginning stages of formulating a budget and selecting an 
appropriate experimental design (see, for example, Howell, 2000, p. 228). 



2. PURPOSE OF THE STUDY 



In view of the above, what is needed is a general model that can provide an 
estimate of the amount of adjustment to a budget necessary to bring power to a targeted 
level. More specifically, the purposes of the study are to (a) derive a procedure using 
Lagrange multipliers for determining the optimal numbers of units for multi-level designs 
with desired power targets, (b) provide more general closed form formulae that enable the 
determination of optimal numbers of units for studies that involve more complex designs, 
and (c) provide a method that optimizes multi-level designs when the estimates of 
variance components are unavailable. Case studies are provided to demonstrate the 
proposed procedure. 
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3. MATHEMATICAL DEVELOPMENT 

3.1 When Estimates of Variance Components are Available 

Let <I> in equation (la) be defined in the context of a design with r levels as 
follows: 



£Tp + Pj/IjCTj + P2^i^ 2^2 ^ Pr 



r 









n«, 

Vi=i y 



+ Pin^af + P2n,n2al+--- + 



(3) 



where i - 1,..., r ; the constants p, are nonnegative integers ; and the constant p, is a 



positive integer. Similar to the role of m in (la), the values of p, are general constant 
coefficients that denote the total magnitude of all other coefficients associated with their 
respective variance component ( erf ). The values of in (3) are the variables of 

concern to select in such a manner that <I> is maximized subject to a budget constraint. 

It can be shown that the ratio of expected mean squares in (lb) is a special case of 
(3) when randomization is performed at the (second) highest level. In general, equation 
(3) would appear with r-2 as; 

^ ^ + P2»l»20'2 (4a) 



Setting p, = P 2 =2 gives equation (lb). If randomization were performed at the (first) 
lowest level then setting P; =0 and p^ =2 in (4a) would give the appropriate expression 
for 0 as: 






(4b) 



Let the total finite budget (fi) associated with executing a study of the form in (3) 
be expressed as follows: 



5 
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( 5 ) 



r r r 

5 = ^, c, n nj + FI «;+••• + ^,c,. 0 +••• + q^c,n ^ , 

y=i j=i j=i 

where i = 1,.-, r , j = i,..., r , and the constants q^ are positive integers. The values of c, 
represent the price per unit of n, . The q^ are general constant coefficients that are used to 

r 

determine the total cost for each of the r product terms (e.g., c, Y[ nj ) in (5). 

j=i 

Combining (3) and (5) more generally in terms of a Lagrangean expression is 
written as: 



Z(n , = f (n, - g(«i n , )] , 



( 6 ) 



where A is the Lagrange multiplier, O = /(n, is the objective function from (3) 

that is maximized subject to (5) for exogenous values of c, , /?, , q^ , a] , and erf for all 



i = 

Without loss of generality, the optimal values of n, can be derived from setting 
r=2 in (5) and subsequently substituting the right-hand sides of (4a) and (5) into the 
general framework of (6). The optimal solutions of n, («,*), «2 and A (A*) are 
expressed as follows (see Appendix 1 for their derivations): 






^2^2 



V 



(7) 
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A* = 



(Tg -t- (T|^2^2'\/ Pi 
Pl^2 

V P\^2^2 ) 



, and 



( 8 ) 



(9) 



In terms of microeconomic analysis, equations (7) and (8) imply that if the 
objective function in (6) is at a maximum (assuming that the objective function is quasi- 
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concave), then the marginal rate of substitution (MRS) of trading for must be equal 



to the price ratio (Cj/cj) of and /ij . This equality MRS = Cj/cj holds ijf = n* and 
/I 2 = «2 ■ It can be shown that n* and yield a maximum by showing that the objective 
function is quasi-concave on the domain consisting only of the nonnegative orthant 
(Arrow & Enthoven, 1961). See Appendix 2 for this derivation. 

More generally, if randomization is performed at the (highest) r-th level for r>2, 
then in addition to n* from (7) the optimal solutions of n * , n * , and A* are expressed as 
follows: 



If randomization is performed at the /-th lower level (for i = 2,..., r -1), then to 
solve for n* substitute equation (7), i - 2 equations of the form in (10), and r - i 
preassigned integers for all n, above the /-th level into the budget constraint of (6) and 
subsequently solve (6) for n* . If randomization is performed at the lowest level ( / = 1 ), 
substitute r - 1 preassigned integers for all n, above the first level into the budget 
constraint and then solve (6) for n* . For convenience to the reader, presented in Table 1 
through Table 3 are the formulae for the optimal solutions of n* for two, three, and four 
level designs at the various possible levels of randomization. 




( 10 ) 






, and 



( 11 ) 





( 12 ) 



ERIC 



7 10 



The solutions of n* given by equations (7), (10), and (11) require that they be 

integral numbers. However, these equations in general do not yield such numbers. 
Therefore, the following rule (Cameron, 1951) for rounding is used with respect to (7) 
and (10): if n,. are positive integers such that n,. < n* < n, +1 round up if 

(n,*)^ > riiirii + 1) otherwise round down. The values of n* in (11) and Tables 1 through 

3 are to be rounded in such a manner that the initial budget estimate (5) is not exceeded. 
Thus, the initial realized budget will be less than or equal to the initial estimate of B. 

The Lagrange multiplier (/I* ) in (12) represents the marginal increase in the 
objective function (O ) of (6) given an exogenous increase of one dollar in the budget 
(5). Presented in Table 4 are the solutions for X in the context of two and three level 
designs under the various levels of randomization. Similar to Tables 1 through 3, the 
extension of the results in Table 4 to larger designs should be clear from the structure of 
the formulae. 

3.2 Targeting a Level of Power 

Given a design with randomization at the i-th level, the integral value of n* 
determined from (11) (or from Tables 1 through 3) may yield an undesirable level of 
power because of an inappropriate initial budget estimate. As such, we define as the 

integral number of units that yields the targeted level of power that is at least as 
large as a prespecified power threshold point denoted as (e.g., = .80). More 

specifically, the targeted level of power is defined to be an element on the following 
interval: 

. (13) 
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The level of power denoted as in (13) is associated with the - 1 unit and 

considered undesirable because it falls below the prespecified minimum value of . 
The upper limit of power denoted as is associated with the + 1 unit and 
considered to be an unnecessary amount of expenditures i.e., the marginal cost of an 
additional unit beyond exceeds the marginal benefit (or gain) in power. 

To determine the amount of change to the initial realized budget such that power 
is at the level of in (13), the estimated F ratio (denoted as F ) is first obtained. In 
general, F is computed by substituting the estimates of the variance components, the 
constant coefficients of p, , and the optimal numbers of n* * , . . . , n* , . . . , n* based on the 
initial realized budget into (3) as follows: 



F = 



+ p.nlnlai + • ■ • + p.j On; ]a^ 



■^7 * 1 I 'I — r * 1 Z 

o-^+/ 7 ,n,o-, +P 2 nin^(T^+--- + p^_AUni K 



♦ ♦ 2 



r-1 



* 



(14) 



Vi=i / 

The critical point from the central F distribution that corresponds with the degrees 

of freedom for F from (14) is subsequently used to determine F^“^ which is the point on 

the noncentral F distribution that yields power of in (13). The value of F^”^ is 

computed by solving equation (30) in Appendix 3 for the noncentrality parameter (t^^”^). 

It follows that; 

^( 0 ) 

F«»=l + :^, (15) 

k 



where is of the form in (2a). See Appendix 3 for further discussion and an example 
for computing 

The change in the initial realized budget (denoted as AB ) is then determined as: 



If > F (or if < F ) in (16), then /iB is the minimum increase (or maximum 
decrease) to the total budget such that power remains greater than or equal to in (13). 



Listed in Table 5 are the general relationships between the total budget 



expenditures and the various levels of power in (13). The value of dBjdn. in Table 5 is 



the derivative of the budget constraint in (5) with respect to n. (for randomization at the 
i-th level) and reflects the change in the total budget that is associated with a per unit 
change in n, . 

3.3 When the Estimates of Variance Components are Unavailable 
In the absence of estimates of the variance components an approach the 
experimenter can take is to ask what would be di minimum effect size worth detecting. 
Using Cohen’s (1988) definition of a standardized effect size (/) and a minimum 
estimated value of cr ^ , the estimate of in (3) can be determined as follows; 



A very useful contribution from Brooks (1955, Table 1) is the pilot study that 
demonstrated the wide range of values that n, in (7) may take and still maintain at least 

90% precision of the true optimum (n,‘ ). With respect to the Brooks (1955) study, 
Cochran (1977) noted, “Because of the flatness of the optimum, these [variance 
components] ratios need not be obtained with high accuracy... the wide interval between 
the lower and upper limits [than maintain 90% precision] is striking in nearly all cases” 




(17) 



(p. 282). Similar points were also made by Moerbeek et al. (2000, p. 278) with respect to 



the flatness of the optimal solutions. 



In view of this point, it is convenient to estimate of variance components in the 
manner suggested by Cochran (1977) as follows: 



where /O, is the intraclass correlation between the elements at the i-th level. Estimates of 
/O, can be obtained from similar studies that report reliability estimates. For example, 

reliability coefficients such as KR-21 are often reported on instruments that take repeated 
or duplicate measures. Otherwise, if other intraclass correlations are unknown, the 
interval considered for estimating the variance components is p. G [.05, .50]. Values of 

/O, outside this interval are considered as unusually low or high intraclass correlations 
(Cochran, 1977). Substituting estimates of /O, and into (18) and solving for cr, in 
terms of a two level design (i.e., i= 1) gives: 



4. CASE STUDIES 

Case 1. Consider a researcher formulating a budget to study the effect of 
conditioned suppression on animal behavior. Of interest to the researcher is the F test for 
differences between groups. The experimenter has data and research results reported by 
Howell (2000) of the effects of conditioned suppression on three groups of rats from a 




(18) 




(19) 



Vl-A ’ 



For r level designs, cr, can be determined from cr,_, as: 




( 20 ) 



three-factor design with repeated measures. (See Howell, 2000, p. 480-484 for the 
complete data set and a discussion on the effects of conditioned suppression. Variance 
component estimates were obtained from the data set using Minitab, 2000.) 

The researcher desires to give each of the animals in the experiment n, 
repeated measures across four different cycles. Suppose the experimenter estimates an 
initial budget of S = $5250 and desires a prespecified power level of at least = .80. 
Presented in Table 5 is a summary of the steps and numerical information for determining 
the optimal solutions for this experiment. As indicated in Table 1, the optimal solutions 
are n[ - 2 repeated measures and - 14 animals for each of groups. Thus, the 
initial realized budget is required to be increased to 5 = $5880 in order to achieve the 
targeted level of power ). 

Case 2. In a study investigating the source of error in viscosity measurements 
taken from shipping vessels. Hocking (1996) reported that the source of error was 
attributed to the differences between the vessels. The study was a two-factor fully nested 
ANOVA that included a single fluid. 

A researcher is subsequently interested in investigating the effects of differences 
between fluids on the measurements of viscosity using k-2 treatment groups. Based on 
the estimates of the variance components (Hocking, 1996, p. 611), the researcher has 
decided that a minimum value of cTj =0.125 would be meaningful to detect with power 

prespecified to be at least = .80. Assume that the researcher has $150,000 available 
for this study. Presented in Table 7 are the estimates of the variance components as well 
as the other relevant information that summarizes this example. From Table 7, the 
optimal numbers for this example are n[ - 2 duplicate trials, nl = 2 independent trials. 
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and = 4 shipping vessels. A total budget of $99,520 is required for the targeted 

power level with randomization at the shipping vessel level. Thus, only about two-thirds 
of the available money to the researcher is required to achieve the desired level of power. 
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Case 3. Suppose that a difference of 20 units between k=2 groups (experimental 
and control) on a new treatment intervention and the standard treatment is considered 
ningful to detect with power of at least = .90. Using Cohen’s (1988) definition of 






a medium effect size ( / = 0.50 ) and equation (17) gives: 



/ .50 



Assume prior research indicates that the instrument taking the duplicate measures 
has good reliability, p^ = .80. The value of is set equal to p^ = .25 (the approximate 
midpoint of the intraclass correlation interval discussed in the previous section). Thus, 
from (19) and (20) the variance component estimates are: 



20{yfm) 
' ~ VI-.8O 



= 40 , and 



23.094. 

VI-.25 

An initial budget estimate is set to 5=$12,500. The various prices for each input 
of the design are listed in Table 8. As indicated in Table 8, the optimal numbers for this 
example are n* = 1 (duplicate) measure, nl =3 independent trials, and = 65 

subjects. A total budget of $36,400 is required with randomization at the subject level. As 
indicated in Table 8 the initial budget was substantially underestimated ($12,500) for 
achieving the targeted level of power. 

In practice, when the variance components are (a priori) unknown, it is prudent to 
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/s 

take an approach that yields conservative (biased downward) estimates of F in (16). The 
consequence of this approach is that it will require a larger total budget to ensure 
achieving a minimum targeted level of power. 

5. CONCLUSION 

The proposed procedure determines the efficient allocation of resources for 
experimental designs that include multi-stage sampling at a given level of randomization. 
The procedure is based on microeconomic analysis for determining optimal states. 
Specifically, given a fixed budget, various prices, and the estimates of variance 
components for a design, the Lagrange multiplier method locates the point where the 
ratio of expected mean squares is at a maximum. At the optimal state, each unit 
purchased will yield the same marginal utility per dollar spent on that unit. As a result, 
each unit will have an identical marginal cost to marginal benefit ratio. 

The procedure presented simplifies the Overall and Dalai (1965) procedure for 
determining optimal solutions to the extent that there is no need to list all possible 
combinations of potential solutions. The example and discussion in Overall and Dalai 
(1965) on the special “zero-overhead” case for a simple repeated measures design is also 
subsumed under the proposed method. That is, if there is no cost associated with each 
subject (i.e., C 2 is arbitrarily close to zero in equations 7 and 8), then test each subject 
once and use as many subjects in the design that the budget allows. 

From the case studies examined, it is evident that the procedure enables the 
researcher to estimate the amount of dollars needed to adjust power to some desired level. 
Using effect sizes and Lagrange multipliers from the model precludes the researcher from 
requesting either too much or too little money when formulating a budget. 
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Table 1. Solutions of n* for a two level design where randomization is at the i-th level. 



Level 

Randomized 


Solution for n* , i = 1, 2 


1 


. _ B-qiCiHi 
— 




q,c,ni 


2 


^ ^ _ 50-1 Va 







Table 2. Solutions of n* for a three level design where randomization is at the i-th level. 



Level 

Randomized 



Solution for n * , i= 1, 2, 3 



1 



, B-q^c^n^n^-q^c^n^ 



n, = 



«2 = 



nj = 



q^c^H2n^ 



-q^c^n^) 



-jq.q^c.c^ + (T^q^c^n^ ^ 



Pi 



-jPlQiq^CiCi + 0-2^3C3 ^ 



Table 3. Solutions of n* for a four level design where randomization is at the i-th level. 



Level 

Randomized 


Solution for n* , i = 1, 2, 3, 4 


1 


. B - qiCinin.n, - qiCin.n, - q^c.n, 

Tl^ = 






2 


-^4C4«4) 




^£^3^4 ^1^2^2^3^4"\/ P\ 


3 


* 0-2V^(^-^4^^4'^4) 




Tl — 

^1^4 V^1^2^3^2^3 ^2^3^3^4 V P2 


4 


« ^^3^J P 3 

Tl — 




+(T^^Piq2q4CiC^ +0-2V^2^3^4C3C4 + 
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Table 4. Solutions for the Lagrange multiplier (/T ) at various levels of randomization for 
two and three level designs. 



Level 

Randomized 


Two level Design 


Three level Design 


1 


_ Pl^l 










2 


_ Pl^2 


_ Pz^3 




+0-iVa^2<^2)^ 




3 




1* Pi^3 

/I- i i i 






+^iVa^2<^2 +0’2V/’2^3<^3)^ 



Table 5. The relationship between power and total budget expenditures. The power levels 
are associated with equation (13). B represents the initial realized budget. The AB 



denotes the necessary change to B to bring power to a minimum acceptable level of . 
The number n* is based on B. The value of is the optimal number to bring power to 

the targeted level of . Randomization is at the i-th level.' 



Power Level 


Power Level and Expenditures 


Total Budget 




Insufficient 


B+[{nr-V)-n]]^ 

dn. 




Minimum 


B+ AB 




Optimal 


B+[ny n,. ] 

dn^ 




Excessive 


R+ ^ 

dn. 



dB 

^Note: Minimum and optimal levels are equal (i.e., ) iff AB = - n*] . 

dn, 



Table 6. Summary of Case 1. The optimal numbers are n* =2 repeated measures, 

= 14 animals for each of the ^=3 (treatment) groups, and with a total expenditures of 

$5,880. Randomization is at the animal (second) level. 

1. Lagrangean expression: 



Z = 



+ Pi^iCTi + P2nin2( 

G ^ + p^n^G^ 



■ + Z\_B - qyn^n2C^ 



1(a). Cost for each animal to enter the experiment: =$100 

1(b). Cost for each repeated measure: Cj =$5 

1(c). Initial budget estimate: 5 = $5,250 

1(d). Variance component estimates: gI =0.01908, G^ =0.00697, G^ =0.00244 

1(e). Integer values of p, and : p^=A, p^=^, qi=\2, q2=2> 



2. Minimum power threshold point: ;r^°^=.80 

3. Initial realized budget: 5 = $5040=(12)(2)(12)($5) + (3)(12)($100) 

4. Optimal integer solutions based on the initial realized budget: 

3(a). Number of repeated measures (eq. 7): n* =2 

3(b). Number of animals per group (Table 1, Level 2): nl = 12 



5. — =$420 = (12)(2)($5) + (3)($100) 
dn2 

6. Lagrange multiplier (Table 4): A* =0.000622 



1 . 



8 . 

9. 



Values of F and F^“^ : 



7(a). For p^ =4, K “2, nl =12 (eq. 14): F =4.13 

7(b). For = .80 (eq. 15 and App. 3 with = - 0.84 ): F^“^ =4.47 
Change to the initial realized budget (eq. 16): AB =$547 

Total expenditures associated with the power points in eq. 

(13) where = 14 yields the targeted level of power (see Table 5); 



9(a). : 

9(b). ;^^“^=.80: 
9(c). : 

9(d). : 



Insufficient $5040 + [1 3 - 1 2] x $420 = $5 ,460 

Minimum $5040+ $547 = $5,587 

Optimal $5040 + [14 - 12] x $420 = $5,880 

Excessive $5040+ [15-12] x $420 = $6,300 





Table 7. Summary of Case 2. The optimal numbers are n* =2 duplicate trials, =2, 
trials, =4 shipping vessels for each of the ^=2 (experimental and control) groups, 

and with a total expenditures of $99,520. Randomization is at the vessel (third) level. 

1 . Lagrangean expression: 

+P2^^2^2 ^ -q^n^n^c^ -q^n^c^] 

+ PiniO-j + 

1 (a). Cost for each shipping vessel: =$9,900 

1 (b). Cost for each trial: =$770 

1 (c). Cost for duplicating each trial: q =$250 
1(d). Initial budget estimate: fi=$150,000 

1(e). Variance component estimates: cr^ =0.03470, <7^ =0.02670, cr^ =0.08180, 

0-3^=0.125 

1(f). Integer values of p, and q^\ Pi = 1, P 2 “ Ps “ ^2 “2, ^3 =2 

2. Minimum power threshold point: = .80 

3. Initial realized budget: 

fi =$149,280 =(2)(2)(2)(6)($250) + (2)(2)(6)($770) + (2)(6)($9900) 

4. Optimal integer solutions based on the initial realized budget: 

3(a). Number of duplicated trials (eq. 7): n* =2 

3(b). Number of trials per vessel (eq. 10): n*2=2 

3(c). Number of vessels per group (Table 2, Level 3): n\=6 




5. — = $24,880 = (2)(2)(2)($250) + (2)(2)($770) + (2)($9900) 
dn^ 



6 . 

7. 



8 . 

9. 



Lagrange multiplier (Table 4): X =0.0000484 

Values of F and : 



7(a). For Pi = P 2 “ P 3 ” 1 * ”2 “2, n\ =6 (eq. 14): F =8.22 

7(b). For = .80 (eq. 15 and App. 3 with = -0.84): =5.75 

Change to the initial realized budget (eq. 16): AB = - $51,033 

Total expenditures associated with the power points in eq. 

(13) where =4 yields the targeted level of power (see Table 5): 



9(a). : 

9(b). ^^^^=.80: 

9(c). : 

9(d). : 



Insufficient $149,280+ [3-6] x $24,8 80 = $74,640 

Minimum $ 149,280 + ( - $5 1,033 ) = $98,247 

Optimal $149,280 + [4 - 6] x $24,880 = $99,520 

Excessive $149,280+ [5-6] x$24,880 =$124,400 
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Table 8 . Summary of Case 3. The optimal numbers are n* = 1 duplicate measures, nl=3 
repeated measures, =65 subjects for each of k=2 groups, and with a total 

expenditures of $36,400. Randomization is at the subjects (third) level. 

1. Lagrangean expression: 



Z = 



+ Pln^(T^ + p^n^n^al 



+ 



i(a). Cost for training each subject: Cj =$100 

1(b). Cost for each test occasion: =$50 

1(c). Cost for duplicating each test: c, =$10 

1(d). Initial budget estimate: fi=$12,500 

1(e). Variance component estimates: =20, cr,^ =40, cr^ =23.094, cTj =100 

1(f). Integer values of p, and : P\-^ Pi-^ P 3 -I ^ 1 -2 ^2 ~2 

2. Minimum power threshold point: - .90 

3. Initial realized budget: 

fi=$I2,320 = (2)(I)(3)(22)($I0) + (2)(3)(22)($50) + (2)(22)($I00) 

4. Optimal integer solutions based on the initial realized budget: 

4(a). Number of duplicated trials (eq. 7): n* = 1 

4(b). Number of test occasions (eq. 10): nl~3 

4(c). Number of subjects per group (Table 2, Level 3): nl =22 



5. — =$560=(2)(I)(3)($I0) + (2)(3)($50) + (2)($I00) 
dn^ 

6 . Lagrange multiplier (Table 4): Z* =0.000150 

7. Values of F and : 

7(a). For p^ - P 2 - P^-^^ =1. ^h-3, /ij =22 (eq. 14): F =2.83 

7(b). For =.90 (eq. 15 and App. 3 with = -1.28 ): =6.39 

8 . Change to the initial realized budget (eq. 16): AB =$23,733 

9. Dollar values associated with the power points in eq. (13) 

where =65 yields the targeted level of power (see Table 5): 

$12,320+ [64-22] x$560=$35,840 
$ 12,320 + ($23,733) = $36,053 
$ 12 , 320 + [65 - 22 ] X $ 560 =$ 36,400 
$12,320+ [66-22] x $560 =$36,960 



9(a). 7T^ : 

9(b). = .90: 

9(c). : 

9(d). : 



Insufficient 

Minimum 

Optimal 

Excessive 
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APPENDIX 1. 

The specific form of the Lagrangean expression in (6) for r=2 is expressed as: 



^ a] + p.n,a} + p.n.n.al ^ 



( 21 ) 



Differentiating (21) with respect to , /Zj > A and equating the partial derivatives to 
zero yields: 



Z„ = — = 0 

an, 



n2 (C/^i (^i<Tg + Pi ^in, <T| + 2p^q^n^(T^ Pi^e ^2 ) 



2x2 



(0-, +Pin,o-i ) 



(22a) 



Z„ = = 0 = -/l(^iniCi +4^2) H — -,^^^1*^2 ^ , and 



«2 



0n, 



+ p^n^G’^ 



(22b) 



02 

Z^= — = 0 = 5- ^iC,n2ni - ^2^2«2 ■ 



(22c) 



Equation (22c) returns the budget constraint. Solving (22a) and (22b) for X gives: 



/l = - 






2\2 



^1^1 (^£ + ppi^G^ ) 



, and 



(23a) 



/l = 



Pifl^Gi 



(^in,Ci + ^2^2 )(Pi^1^1 ) 



(23b) 



Dividing (23a) by (23b) and multiplying through both sides by the price ratio {c^jc ^ ) 
yields: 



^1 _ "^^2^2) 

C 2 ^,n,C2(cr^ +Pin,cri4 



(24) 



Solving (24) for n, gives the optimal number of n,* in equation (7). Subsequently 
substituting the right-hand side of (7) into the constraint of (21) and into (23a) gives the 
optimal numbers of nl and X in equations (8) and (9) respectively. 



APPENDIX 2. 



The first and second-order partial derivatives of O (the objective function) in 
(21) with respect to and are as follows: 



do 

dn, 

do 

d«T 



J rit , 2 






= .L. = 









dnf {a] + p,n,criy 



d"o 

dnl 



= f„„ = 0 , and 

J n-jH-y ’ 



d^O d^O 



= f = f = 

J ntfij J n-jrii 



PifT^al 



driyrij dn^n^ (cr^ + P|n|£T|^)^ 

The determinantal test for quasi-concavity is (Chiang, 1984, p. 394): 

< 0 , and 



1— 


0 /„. 




^doV 


Pi = 




= — 




1 ^ 1 


f f 

J J «!«! 







^2 = 



0 /„. 4 

f n^ f riitii f n^ri2 

f >f n^rii f 



= 2 



do do d'L 



2 r A 



v^d/Z; d«2 dn^n^ J 



doYfd^o 

V y 



(25) 

(26) 

(27) 

(28) 
(29) 



V^«2y 









d'O 

a«2 y 



>0. 



On substitution of (25) through (29), it follows that: 



O, = - 



2 2 
P2^2^e ^2 



2\2 



(£T, + p,n,a , ) 



y 



P 2 =2 



/ 2 2 



< 0 , and 



Pl^x^l 



>^2^2 \ 
Pl^e ^2 

2x2 



{a] + p,n,alf a] + p.n.a^ {a] + p,n,a^) 



P2«l^^2 ^ 


Y 


^P\P2^2^ £^\ ^2 




f 2 2 

P2^2^ e ^2 


e P\^\^\ J 


V 






{{al + p,n,ay) 



( 0 )> 0 , 



because n^, n^, and p^ are positive and p^ is nonnegative. Hence, O is quasi-concave. 
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APPENDIX 3. 



The value of in equation (15) is based on the following expression (Winer, 
1991, p. 136): 



2 



( 0 ) _ 






(2v, -1) 






u 



2 1 






(2^1 - S) 



Wj +2S 

v^+S 



V 7). V. + ^ 

% ^ 'I 



(30) 



where is unit normal, J is a noncentrality parameter, and and are the degrees 
of freedom associated with the numerator and denominator of the F ratio. If F^ in (30) is 



a point on the F ( Wj , ^ 2 . ^ ) distribution, then the Pr(F> F^ ) = Pr(^ > ). Setting in 

(30) to the appropriate value associated with minimum power of in (13) and solving 

for S gives . Because is of the form in (2a) it follows that: 

^(0) 

f = iH which appears in equation (15). 

k 



As an example, from the initial realized budget in case 1, we have degrees of 
freedom of t>, =2, =33, and a critical point of F^ =3.28. Because = .80 in (13) we 

set = -0.84 . Substituting these values into (30) gives: 



-0.84 = 



V 



[2(33)-l](2)(3.28) 



33 



V 



[2{2)-S] 



2 + 2S 
2 + S 



l{2){3.28) _^2 + 2S 



(31) 



33 



2 + S 



Numerically solving (31) for S , using the equation solver FindRoot (Wolfram, 
Mathematica, version 4.0, 1999), gives = 10.41. Thus, given that ^=3 for this case 



10 41 

we have F^°^ = iH iH ^ — =4.47. 
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